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ABSTRACT 

We  consider  a  binary  detection  problem,  when  the 
data  are  obtained  from  m  distant  sensors,  and  modelled  as 
stationary  Gaussion  processes,  with  different  spectra.  We 
also  assume  that  inaccurate  versions  of  the  true  statistical 
models  are  utilized,  and  we  develop  upper  bounds  to  the 
probability  of  error,  based  on  the  Chemoff  bounding 
approach.  Those  bounds  also  converge  to  the  asymptotic 
probability  of  error  as  the  number  n  of  data  points  increases 
to  «.  Conditions  for  sustaining,  in  spite  of  mismatch, 
exponential  convergence  of  the  error  probability  to  zero 
with  n  are  determined. 


INTRODUCTION 

There  has  been  much  interest  recently  in  the  signal 
detection  problem  for  data  available  from  multiple  sensors 
[11  -  [7].  In  this  paper  we  develop  bounds  to  the  probabil¬ 
ity  of  error  for  binary  detection  from  multisensor  data, 
when  inaccurate  versions  of  the  actual  statistics  are  incor¬ 
porated  into  the  decision  rule.  We  specifically  investigate 
the  error  probability  for  detection  in  Gaussian,  stationary 
processes  with  inaccurately  known  spectra. 


SUMMARY  OF  RESULTS 

Suppose  that  m  sensors  are  utilized  for  deciding 
between  two  hypotheses,  Hi ,  Ho-  Let  xjj  =  (xkl  •  ■  ■  be 
the  data  vector  for  the  kth  sensor,  distributed  according  to 
the  probability  density  function  fjk(xjJ)  for  j=0,l  under 
Ho,  Hi,  correspondingly.  Suppose,  also,  that  g,k(xj)  is  the 
inaccurate '  version  of  f,k(xjj)  that  is  used  in  the  decision 
rule.  We  will  assume  throughout  this  paper  that  the  data 
from  different  sensors  are  statistically  independent.  This 
assumption  will  be  removed  in  a  subsequent  paper. 
Because  of  the  independence  between  distinct  sensors,  the 
likelihood  ratio  test  is: 

•  Decide  Ht  if  nTl  £  q]((Xk);>T  (l) 

le=l 


where: 


qicUk)  =  n‘l 


,  gik(*k) 

•  log - — 

gok(*E) 


(2) 
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is  the  "mismatched"  log  likelihood  function  of  the  kth  sen¬ 
sor. 

Let,  for  j=0,l: 

Pj(f.g.n)  =  Probability  of  erroneously  deciding  H,  using 
( gjk )  and  based  on  n  measurements. 

We  will  utilize  the  Chemoff  bounding  technique,  and 
subsequently  relate  the  bound  to  "large  deviauon  theory  " 
[8],  [9],  as  n— 

The  basic  Chemoff  bound  is: 

P0(f,g,n)  =  Pitm*1  £zk>TIH0] 

k=l 


<  E0exp[t(m  1  £  zk-T)]  = 

k=l 

=  FI  Eo  exp[tm‘1(Zk-T)]  ,3) 

k*l 

Pi(f,g,n)  =  Prfm_1  £  zk  STIH,] 

k=l 

t  m 

£Ei  cxp(-r(m  £  zk —T)J= 

k=sl 

=  I!  Ei  exp  RnT 1  (Zk~T)]  ,4) 

k=l 


for  tiO,  Ej  =  expectation  under  Hr  Note  that  the  bound  (31 
is  less  that  1  for  some  £20,  if  and  only  if: 

m“l  £  EpZk  <  T  (5) 

k=l 


Similarly,  (4)  is  less  than  1  for  some  t20,  if  and  only  if: 

m‘1£E,Zk>T  ,6) 

lc=l 

Let,  now: 

Zk  =  n'1  log  [gikUk)/gokUk)l  171 

be  the  mismatched  log-likelihood  function  for  the  kth  sen¬ 
sor.  and  s=t  n“‘>0.  Straightforward  calculation  provides  us 
with  the  following  expressions: 

E0  cxp(tm'1(Zk-T)]=}f0k(Xk)[gik(x!|)/gok(x|;)ls'm 


J 


U 

□ 


Dist 


A,  ,;i  ,( i  I  or 

SpuClai 


dxk  •  exp(-snT/m).  (*> 

E)  exp[-tm‘!(zk-T)]  =J  fik(xk)(gik(xk)/gok(*k)r‘/m 

dxk  •  cxp(snT/m)  (9) 

E0  zk  =  n'1  j  f0k  (xj|)  log  [gik(xk)/gok(xk)]dxk  (10) 
Ei  zk  =  n*1  j  fik  (xjj)  log  [gik(xk)/gok(xk)]dx!J  (11) 
Define  the  functionals: 

Gk  [f.  gilt  got  n.s|^ 

n'1  log  j  f(xE)(gik(xf)/g0k(x5)]5/m  dxk  (12) 

Taking  logarithms  of  (3),  (4)  and  using  (8),  (9),  (12),  we 
find  the  bounds: 

m 

n"1  log  P0(f»g*n)  £  £  Gk[f0k,gik»gOk>n,s|-sT.  (13) 

k=l 

'  m 

n  log  Pi(f,g,n)  £  £  Gk[fik.gik^gOk»n,-sl  +  sT.  (14) 

k=l 

We  observe  that  if  Gk  denotes  the  derivative  of  Gk  with 
respect  to  s,  then,  from  (10),  (12),  (7): 

Gk[fok,gik,gok.n,0]  =  m'‘ Eo  zk.  (15) 

Gk[ftk,gik,gok.n,01  =  nT1  E(  zk.  (16) 

Hence,  if  (5)  is  satisfied,  the  slope  of  the  upper  bound  (13) 
at  s=0  is  negative,  and  the  bound  is  zero  at  s=0.  Similarly, 
if  (6)  is  satisfied,  the  slope  of  the  upper  bound  ( 14)  at  s=0  is 
negative,  and  the  bound  is  zero  at  s=0.  Also,  both  bounds 
( 131  and  (14)  are  convex  with  respect  to  s. 

The  tightened  Chemotf  bounds  ( 1 3),  ( 14)  are: 

n  log  Po(f,g,n)  <,  inf  £  Gk[f0k,gik,gok,n,s|-sT.  ( 17) 
s  k=i 

1  m 

n~‘  log  Pi(f,g,n)  <inf  £  Gvrr  gik.gok.n,-sl+sT(i8) 

5  k=i 

Suppose,  now,  that  for  the  class  of  statistical  models  we 
consider,  the  limits: 

lim  Gklfjk.gut.gok.n.sl  ^  Gk(f)k,glk,gok,°°.s|  (19) 

exist,  for  k=l . m,  j=0.l 

Suppose,  also  that: 

lim  n'1  £  Jfok  (xj)  log  [gik(xE)/gok(xE)jdxjJ<T  (20) 
n-“*  k=l 

lim  n"[  £  /  fik(xj)  log  [gik(xiJ)'gok(xE)]dxS>T  (21) 

r>—  lei 


Then,  utilizing  the  results  of  Large  Deviation  Theory,  (8), 
[9],  we  find: 

lim  n"1  log  P0(f,g,n)  = 

m 

inf  £  Gk[f0k,gik.g0k,«,sl-  sT.  ,22) 

5  k=i 

lim  n'1  log  Pi(f,g,n)  = 

m 

inf  £  Gk[flk,gik,g0k,~>,-sl+  sT  (23) 

s  k=t 

It  is  interesting  to  observe  that  the  bounds  (17),  (18) 
become  the  exact  asymptotic  error  probabilities  as  n->~ 
This  is  the  essence  of  Large  Deviation  Theory  18],  [9]. 

We  will  now  concentrate  on  a  major  class  of  statisti¬ 
cal  models  for  which  the  limits  (19),  (20),  (21)  exist.  This 
is  the  class  of  Gaussian,  stationary  random  processes  with 
zero  means  and  different  spectra.  Consider  three  multivari¬ 
ate  Gaussian  probability  density  functions 
f(xn),  g(x"),  go(xn)  with  zero  means  and  covanance 
matrices  F.  Q,  Q.  We  calculate  the  integral  of  eq  ( 12): 

Gff.gi  go. n.0]=n~l  log  j  f(xn)[gi (xn )/go(xn )idd.xn= 


=  ~[n-‘  log  IFT'+OQ-OQ1  I  -  n‘!  log  1FT1  '  - 


-0-n'1  log  I  Cj 1  I  +0-n_1  log  I  Cq1  1 


1 24) 


Taking  the  limit  as  n— ,  and  using  the  results  of  (10], 
[11],  we  find: 

^Gff.gLgo.-.Ol^itr1  J  (log(r‘(A.)+0cri(/t)-0coi(^)|- 


-  log  r'(k)  -  0  log  c  (X)  +  0  log  cii1 i^)  IdA.  1 -5 1 

where.  f(k),Ci(A.),Co(A.)  are  the  three  spectra  corresponding 
to  f.gi.go,  and  it  is  assumed  that  they  are  strictly  positive 

for  all  Xe[-rc,it].  Using  (25)  for  k=l . m.  and  assuming 

that  for  the  kth  sensor  the  true  spectra  are  { ( A), x, k  1  } 
under  Ho, Hi,  and  the  assumed  spectra  are  lgok(k),  glkiA.)| 
under  Ho,H! ,  we  can  evaluate  the  rates  in  (22).  (23). 

The  necessary  and  sufficient  conditions  in  order  for 
Pn(f.g.n)  and  Pt  (f,g,n)  to  converge  exponentially  to  zero, 
are  that  the  derivatives  of  (22).  (23)  at  s=0  are  negative, 
which  are  equivalent  to  (20),  (21).  The  derivative  of  G 
with  respect  to  0  at  0=0,  is: 

It 

-2G' [ f. gi , go , 0=O]=( 2it)~ 1  j  (f(\)[c71(A.)-co‘(/u]- 


-  logc0(A.)c]'1(X)]d>..  (26) 

The  condition  of  negative  slope  at  s=0  of  (22)  is: 

,  *  m 

(2tt)  j  £  (fok(^)(gik(^.)  -  gok(^)f  - 

-ft  te=l 

t°ggok(*-)gik(*-))dX  +  2T>0  ,27) 
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The  condition  of  negative  slope  at  s=0  of  (23)  is: 

*  m 

(2jtrl  J  KfikO-HgTkO-i-gok^)!- 

-k  k=l 

loggok(^)grk(>-)l<^-2T>0,  (28) 

Conditions  (27),  (28)  guarantee  exponential  convergence  of 
P0,P,  to  zero,  correspondingly.  It  can  be  shown  that  if  (27) 
is  not  satisfied,  then  Po  converges  to  1  as  n-*».  Similarly, 
if  (28)  is  not  satisfied.  Pi  converges  to  1.  The  proof  of  the 
latter  fact  is  not  given  here,  but  it  will  appear  in  the 
expanded  version  of  the  paper. 

Let  us  define  the  spectral  distance  measure: 

it 

i(f,g)  =  (2itr'  |  {ftt.)g-l(X)-  i- 

-R 

log  f(X)  g-1(A.))dX  (29) 

Because  of  the  identity  x-1  S  log  x,  it  is  seen  that 
l(f.g)>0  with  equality  if  and  only  if  f(A.)  =  gt a.)  for  almost 
all  X£[-Jt.ir|.  After  some  algebraic  manipulations,  condi¬ 
tion  (27)  is  expressed  as: 

2  Ufok-gik)  -  Kfok>  gOk)  +  2T  >  0  (30) 

k=l 

Similarly,  condition  (28)  is  expressed  as: 

X  Kfik.  glk)  ~  (flk.  gOk)  ~  2T  >0  (31) 

k=l 

Combining  (30)  and  (31),  we  see  that  the  necessary 
and  sufficient  condition  for  exponential  convergence  of  the 
error  rate  to  zero,  is  the  satisfaction  of  the  double  inequal¬ 
ity: 

2“'  2  Kfik.  gtk)  -  I(fu.  gok)  >  T  > 

k=l 

>  2-1  y  I(foi<,  gok)  ~  Iffok.  gtk)-  (32) 

k=l 

As  long  as  the  leftmost  side  of  (32)  is  larger  than  the 
rightmost  side,  we  can  always  pick  a  threshold  T  between 
those  two  numbers  to  achieve  asymptotic  convergence  of 
the  error  rates  to  zero.  For  the  special  case  of  matched 
statistics,  we  have  flk  =gik.  fok  =  gOk-  and  the  condition 
(32)  becomes: 

2*1  £  Hf ik.  fok)  >  T  >  -  2_I  £  I(f0k.  fik)  (33) 

tel  tel 

We  note  that  (33)  can  always  be  satisfied  for  some  T, 
because  the  leftmost  side  is  nonnegadve.  and  the  rightmost 
side  nonpositive.  Thus,  in  the  "matched"  case,  exponential 
convergence  hinges  only  upon  the  choice  of  T. 

To  evaluate  the  actual  rates  of  convergence,  we  need 

to  use  expression  (25)  for  k=l . m  into  (22).  (23)  and 

minimize  with  respect  to  s. 


CONCLUSIONS 

We  have  obtained  the  rates  of  convergence  of  error 
probabilities  in  multisensor  detection  for  a  binary 
hypothesis,  and  we  determined  the  conditions  of  exponen¬ 
tial  convergence  in  the  presence  of  mismatch.  The  condi¬ 
tions  are  necessary  and  sufficient. 
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MISSION 


Rome  Air  Development  Center 


RADC  plans  and  executes  research,  development,  test  and 
selected  acquisition  programs  in  support  of  Command,  Control, 
Communications  and  Intelligence  (C*I)  activities.  Technical  and 
engineering  support  within  areas  of  competence  is  provided  to 
ESD  Program  Offices  (POs)  and  other  ESD  elements  to 
perform  effective  acquisition  of  CPI  systems.  The  areas  of 
technical  competence  include  communications,  command  and 
control,  battle  management  information  processing,  surveillance 
sensors,  intelligence  data  collection  and  handling,  solid  state 
sciences,  electromagnetics,  and  propagation,  and  electronic 
reliability /maintainability  and  compatibility. 


